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ABSTRACT 

This  paper  describes  an  adjustment  procedure  for  observer-based  linear 
control  systems  which  asymptotically  achieves  the  same  locp  transfer 
functions  (and  hence  the  same  relative  stability,  robustness,  and  distur¬ 
bance  rejection  properties)  as  full-state  feedback  control  implementations. 
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I.  Introduction 

The  trouble  with  observers  is  that  they  tempt  us,  through  the  expedient  of 
state  reconstruction,  to  assign  undue  generality  to  control  results  proven 
only  for  the  full-state  feedback  case.  An  example  is  the  recent  robustness 
result  of  Safonov  and  Athans  £lj.  This  result  shows  that  multivariable 
linear-quadratic  optimal  regulators  have  impressive  robustness  properties, 
including  guaranteed  classical  gain  margins  of  -6  db  to  +  •  db  and  phase 
margins  of  +  60  deg.  in  all  channels.  The  result  is  only  valid,  however, 
for  the  full  state  case.  If  observers  or  Kalman  filters  are  used  in  the 
implementation,  no  guaranteed  robustness  properties  hold.  In  fact, 
a  simple  example  has  shown  that  legitimate  LQG  controller-filter 
combinations  exist  with  arbitrarily  small  gain  margins  in  both  the  positive 
and  negative  db  direction  [2!. 

w 

In  light  of  these  observations,  the  robustness  properties  of  control  systems 

with  filters  or  observers  need  to  be  separately  evaluated  for  each  design. 

Moreover,  because  such  evaluations  can  come  up  with  embarassingly  small 

margins,  a  "design  adjustment  procedure"  to  improve  robustness  would  be  very 

desirable.  The  present  paper  provides  such  a  procedure.  We  show  that  while 

the  commonly  suggested  approach  of  "speeding-up"  observer  dynamics  will  not 

work  in  general,  alternate  procedures  which  drive  some  observer  poles 

toward  stable  plant  zeros  and  the  rest  toward  infinity  do  achieve  the  desired 

objective.  In  effect,  full-state  robustness  properties  can  be  recovered 

asymptotically  if  the  plant  is  minimum  phase.  This  occurs  at  the  expense  of 
noise  performance. 


The  principal  results  of  the  paper  are  sumnarized  in  Section  II,  where  we 
Introduce  and  interpret  certain  transfer  function  properties  of  observer- 
based  control  systems,  and  in  Section  III,  where  we  develop  the  "adjustment 
procedure".  A  simple  example  which  illustrates  these  results  is  given  in 
Section  IV. 
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IB.  Observer-Based  Implementation 


II.  Transfer  Function  Properties  of  Observer-Based  Controllers 
We  consider  the  general  multivariable  control  loop  illustrated  in  Figure  1. 
The  plant  is  an  n-th  order  linear  system,  both  observable  and  controllable, 
with  m  inputs,  p=m  outputs,  and  no  transmission  zeros  ^31  in  the  right  half 
plane.  The  control  law  consists  of  two  transfer  function  matrices  (s)  ^d 
^(s).  Hg  is  driven  either  with  full-state  feedback  (Fig.  1A)  or  with  an 
n-th  order  "model -reference  observer"  [4}  which  reconstructs  the  state  in  the 
usual  asymptotic  sense  (Fig.  IB).  It  is  clear  that  this  overall  control  loop 
includes  linear-quadratic-gaussian  controllers  as  special  cases.  It  also 
allows  dynamic  elements  such  as  integrators  and  lag  elements  which  may  be 
required  in  more  realistic  control  situations. 


This  configuration  also  applies  to  nonsquare  plants  for  which  the  number  of 
controls,  m,  is  not  equal  to  the  number  of  measurements,  p.  For  the  case, 
m<p,  simply  augment  the  original  control  vector  with  (p-m)  more  components 


H1  =  Hn-°]  )• 


Columns  of 


which  are  not  driven  by  the  controllers  (i.e.,| 
the  B  matrix  for  these  added  components  must,  of  course,  be  selected  to  intro¬ 
duce  no  unstable  transmission  zeros. 


For  the  case,  m>p,  select  any  p-  dimensional  subset  of  controls  for  which 
there  are  no  right  half  plane  transmission  zeros.  Then  the  loop  transfer 
properties  which  are  established  in  this  paper  apply  to  this  p-dimensional 
subset  of  control  loops,  with  the  remaining  (m-p)  loops  closed. 

A  dashed  line  is  shown  in  both  Figure  1A  and  IB  in  order  to  distinguish 
between  elements  of  the  loop  which  are  part  of  the  controller  and  those 
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which  are  part  of  the  plant.  Since  we  design  and  implement  the  controller, 
there  is  relatively  little  uncertainty  associated  with  it,  whereas  there  may 
be  significant  differences  between  the  actual  plant  and  its  model.  The  loop 
transfer  functions  which  we  examine  for  robustness, below,  are  then  taken  with 
respect  to  the  loop  breaking  point,  X,  at  the  control  signal  interface  be  ween 
these  two  sets  of  elements.  Very  misleading  robustness  results  can  be  ob¬ 
tained  for  alternate  loop  breaking  points,  for  example  point  XX.  This  is 
also  shown  below. 

The  following  properties  can  be  established  for  the  above  two  control  loop 
implementations: 

Property  1 

The  closed  loop  transfer  function  matrices  from  command  r  to 
state  x  are  identical  in  both  implementations. 

Property  2 

The  loop  transfer  function  matrices  from  control  signal 
u'  to  control  signal  u  (loops  broken  at  point  XX)  are 
identical  in  both  implementations 

Property  3 

The  loop  transfer  function  matrices  from  control  signal 
u"  to  control  signal  u*  (loops  broken  at  point  X)  are 
•  generally  different  In  the  two  implementations  even  when 

the  observer's  error  dynamics  are  allowed  to  be  arbitrarily 
fast. 
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Property  4 

The  loop  transfer  function  matrices  from  u"  to  u*  are 
identical  in  both  implementations  if  the  observer 
dynamics  satisfy 

K  [i  +  C  (sI-A)_1k]  *l  *  B  [c( si -A) ”1B  ]  -1  (1) 

for  all  values  of  the  complex  variable  s.  The  A,  B, 
and  C's  above  are  plant  matrices  and  K  is  the  observer 
gain. 

The  first  two  of  these  properties  are  very  well  known  ^5,6j.  They  can  be 
easily  verified  by  noting  that  the  transfer  functions  from  u'  to  x  and  from 
u'  to  x  are  identical  because  the  nominal  error  dynamics  of  the  observer  are 
not  controllable  from  u'.  These  two  properties  are  also  the  source  of  much 
of  the  temptation  surrounding  observers,  however.  We  see  that  input/output 
properties  are  the  same  and  even  certain  loop  transfer  functions  are  the 
same.  The  latter  promise  equal  relative  stability  properties,  equal  toler¬ 
ance  to  uncertainties  (robustness),  and  equal  disturbance  rejection  properties. 
What  more  could  we  ask  for? 

The  problem,  of  course,  is  that  the  loop  transfer  properties  are  the  same 
at  Point  XX,  inside  our  own  control  implementation  where  only  masochists 
would  Insert  significant  uncertain  elements  or  disturbances.  According  to 
Property  3,  equal  loop  transfer  characteristics  are  not  obtained  at  the 
control  signal  Interface  to  the  plant,  Point  X,  where  Nature  gets  to  insert 
uncertainties  and  disturbances.  It  is  at  this  point  that  robustness  prop¬ 
erties  must  be  measured,  and,  as  seen  in  [2I,  it  is  here  that  observer- 
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based  Implementations  can  fall  well  short  of  our  objectives. 

Property  3  will  be  verified  by  means  of  example  later.  We  now  turn  instead 
to  the  more  interesting  Property  4.  This  result  is  apparently  not  as  well 
known,  so  a  simple  derivation  is  given  in  Appendix  A.  It  is  important  be¬ 
cause  it  offers  a  way  to  adjust  observers  so  that  full-state  loop  transfer 
characteristics  are  recovered  at  Point  X.  In  particular,  suppose  the  observer 
gains  are  parameterized  as  a  function  of  a  scalar  variable  q.  Let  this 
function,  K(q),  be  selected  such  that  as  q  -*•  • 

K(q)  -  q  BW  (2) 

for  any  nonsingular  matrix  W.  Then  equation  (1)  will  be  satisfied  asymtot- 
ically  as  q  *  ®.  The  resulting  observer  error  dynamics  will  have  limiting 
poles  given  by  roots  of  the  polynominal 

x(s)  =  det(sI-A)det  [i  +  qC(sI-A) BW ]  . 

P  of  these  roots  will  tend  toward  the  P  finite  transmission  zeros  of  the 
plant  (stable  by  assumption)  and  the  rest  will  tend  to  infinity.  It  is 
clear  from  this  that  the  commonly  suggested  approach  of  making  all  roots  of 
the  error  dynamics  arbitrarily  faster  is  generally  the  wrong  thing  to  do. 
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III.  An  Observer- Adjustment  Procedure 

Equation  (2)  defines  the  required  limiting  characteristics  of  an  adjustment 
trajectory,  K(q),  which  changes  arbitrary  initial  nominal  observer  gains, 

K(o),  with  poor  robustness  properties  into  better  gains  asymptotically.  We 
still  need  to  define  details  of  such  trajectories. 

A  basic  requirement  for  every  point  of  an  adjustment  trajectory  is  stabil¬ 
ity  of  the  observer  error  dynamics.  Clearly,  if  we  violate  this  require¬ 
ment,  overall  closed  loop  stability  is  also  lost.  (Note  that  this  does 
not  mean  that  the  net  compensator  within  the  dashed  lines  of  Figure  IB 
needs  to  be  stable.)  One  way  to  assure  stable  error  dynamics  is  to 
restrict  the  observer  to  be  a  Kalman  filter  for  some  set  of  noise  param¬ 
eters.  That  is,  let 

K(q)  =  l(q)  CT  R"1  (4) 

with  z(q)  defined  by  the  Riccati  equation 

Al  +  IAT  +  Q(q)  -  rcV^E  =  0  (5) 

As  usual  we  take  Q  =  >*o  and  R  =  R^  >o.  For  Kalman  filters,  these 

matrices  represent  given  process  noise  and  measurement  noise  intensities, 
respectively.  Here  they  are  treated  more  freely  as  design  parameters 
which  we  can  select  to  suit  broader  purposes.  In  particular,  let 

Q(q)  *  Q0  +  q2BVBT  (6) 

R  -  R0  (7) 

where  Q  and  R  are  noise  Intensities  appropriate  for  the  nominal  plant, 

0  0 

and  V  is  any  positive  definite  synmetric  matrix.  With  these  selections. 
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the  observer  gain  for  q  =  o  corresponds  to  the  nominal  Kalman  filter  gain. 
However,  as  q  approaches  infinity,  the  gains  are  seen  from  (5)  to  satisfy, 

K  R  KT - >  q2  BVBT 

and 

K  — >q  B  Vj  R\l,  (8) 

where  Vj  denotes  some  square  root  of  V  (V^vJ  =  V)  and,  similarly,  is 
some  square  root  of  R.  Since  (8)  is  a  special  case  of  (2),  it  follows  that 
the  adjustment  procedure  defined  by  (4)- (7)  will  achieve  the  desired  robust¬ 
ness-improvement  objective. 

Note  that  the  second  term  in  equation  (6)  can  be  interpreted  as  extra 
process  noise  added  directly  to  the  control  input  of  the  plant.  Within 
the  constraints  of  Kalman  filter  mathematics,  such  "fictitious  noise"  is 
a  natural  mechanism  to  represent  uncertainties  at  this  point  of  the 
control  loop.  It  is  nice  to  know  that  the  resulting  filter  design  act¬ 
ually  responds  with  a  corresponding  robustness  improvement.  Note,  how¬ 
ever,  that  arbitrary  increases  of  the  existing  noise  matrix  (i.e., 

Q  =  (1  +  q‘)  Qq)  or  addition  of  arbitrary  full  rank  noise  process 
(I.e. »  Q  *  Qo+  q  W  with  W  *  W  >o)  which  are  often  suggested  as  other 
Intuitive  robustness  improvement  methods,  will  not  in  general  produce 
the  desired  effect. 

Finally,  we  note  that  the  use  of  Kalman  filter  equations  in  the  adjust¬ 
ment  procedure  is  not  fundamental.  The  filters  merely  provide  a  conven¬ 
ient  way  to  assure  stability  along  the  entire  adjustment  trajectory. 

Any  other  procedure  (pole  placement,  for  example)  with  the  same  limiting 
properties  (2)  could  be  used  as  well. 


IV.  An  Example 

To  illustrate  the  observer  properties  and  adjustment  procedure  above, 
consider  the  following  example: 


Plant: 


dx 

dt 


f  °  ‘1 


t  x  + 


-3  -4 


Ol 

1  ' 


u  + 


35 


-61  1 


i  £ 


(9) 


y  -  2  1  1  x  +  n 


(10) 


with  E  (e)  =  E  (n)  =  0; 
Controller: 


E  [?(t)c(T)]  ■  E^n(t)n(i)  =  6 ( t-x ) 


u  =  •  -50  -10 


]  x  +  [  50  ]  r 


(11) 


The  plant  in  this  example  is  a  (harmless)  stable  system  with  transfer  function. 


~$s)  =  (V  ~nfs2+  3) 

The  controller  happens  to  be  a  linear-quadratic  one,  corresponding  to  the 
performance  index 


(12) 


with 


■  I-v 


Hx  +  u^)  dt 


(13) 


H  «  4  5 

It  places  the  closed  loop  regulator  poles  at 

s  «  -7.0  +  j2.0 


35 


J 
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A  Nyquist  diagram  (polar  plot  of  the  loop  transfer  function  at  Point  X'  for 
the  full-state  design  is  given  in  Figure  2.  Gain  margin  is  infinite  in  both 
directions  and  there  is  over  85°  phase  margin.  The  design  is  then  implemented 
using  a  Kalman  filter  for  the  given  noise  parameters.  The  Nyquist  plot  for 
the  resulting  observer-based  controller  is  also  shown  in  Figure  2.  Oops.  . 
less  than  15°  phase  margin. 

In  an  effort  to  improve  this  margin,  one  adjustment  to  the  filter  that  could 
be  made  is  to  speed  it  up.  So,  we  can  try  moving  the  filter/observer  poles 
to  the  left  in  a  second-order  Butterworth  pattern.  For  the  filter/observer 
poles  at  -22-17 . 86 j  one  gets  the  third  Nyquist  plot  in  Figure  2.  As  can 
be  seen,  the  results  are  less  than  satisfactory-  Not  only  are  the  margins 
disappearing  (now  less  than  10  degrees)  but  the  loop  bandwidth  has  increased 
(crossover  has  gone  from  approximately  12.  to  40.  rad/sec). 

Unless  we're  trying  to  design  an  explosive  device,  this  is  clearly  undesir¬ 
able.  It  gets  worse  as  the  filter  gets  faster.  In  fact,  it  can  be  shown 
that  the  margins  go  asymptotically  to  zero  for  large  gains,  while  the  loo? 
bandwidth  goes  to  infinity.  The  present  example  is  not  a  pathological  one, 
either.  Similarly  undesirable  characteristics  for  fast  filters  are  obtained 
with  most  systems. 

When  the  observer  adjustment  procedure  of  Section  III  is  applied  to  the 
same  example,  much  more  pleasing  behavior  is  obtained.  Following  (6)-(7), 
we  let  the  process  noise  covariance  matrix  be 
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(35  -61) 


,  /°\ 
*■  l, 


We  then  increase  q  from  zero  until  a  reasonable  compromise  between  noise 

performance  and  robustness  is  achieved.  Some  results  of  this  process  arj 

summarized  in  Figure  3  and  Table  1.  Figure  3  shows  Nyquist  diagrams  for 
2 

q  *  100,  500,  1000,  and  10,000.  Margins  improved  with  essentially  no 
change  in  bandwidth  as  the  modified  loop  transfer  function  tends  toward 
full  state  optimal.  Noise  performance  is  summarized  in  Table  1  for  the 
same  set  of  q  values.  As  expected,  the  error  covariance  of  the  adjusted 
filter  with  respect  to  the  original  noise  increases  markedly  with  q. 
However,  there  was  not  the  same  deterioration  in  state  covariance. 


Table  1  also  documents  other  parameters  associated  with  these  design 
points  —  poles  of  the  error  dynamics,  margins,  and  filter  gains.  Note 
in  particular  that  the  filter  poles  tend  toward  the  plant  zero  and  toward 
infinity,  as  required  by  (3). 


This  adjustment  procedure  was  also  successfully  applied  to  reconstruction  of 
measured  outputs  after  sensor  failures  for  the  A7-D  aircraft.  ^8j  In 
this  application  the  optimum  Kalman  filter  produced  an  unstable  system 
when  tested  in  hybrid  simulation  over  the  A-7D  flight  envelope.  After 
attempts  with  "ad  hoc"  fictitious  noise  adjustment  procedures  failed  the 
method  discussed  here  successfully  stabilized  the  system.  Also,  the 
resulting  error  covariance  properties  remained  closed  to  the  optimum 
values. 


V.  Conclusions 


This  paper  illustrates  some  of  the  difficulties  one  can  get  into  by  relying 
on  observers  for  state  reconstruction.  We  have  concentrated  on  robustness 
properties.  In  general,  these  will  be  poorer  for  observer-based  implemen¬ 
tations  than  for  full-state  implementations.  For  minimum-phase  systems, 
however,  full-state  robustness  can  be  recovered  asymptotically  provided  it 
is  done  correctly.  Fast  observers  are  not  in  general  correct.  A  "fictitious 
noise"  adjustment  procedure  was  suggested  which  is. 

The  apparent  practical  value  of  this  procedure  is  that  it  gives  a  simple 
way  of  trading  off  between  noise  rejection  and  margin  recovery.  When 
q  «  0,  the  filter  will  be  optimal  with  respect  to  the  "true"  (as  modelled) 
system  noise.  As  q  increases  the  filter  will  do  a  poorer  job  of  noise 
rejection  but  the  closed- loop  stability  margins  will  improve.  Hopefully, 
a  satisfactory  compromise  can  be  found  through  the  adjustment  of  the  single 
parameter  q.  We  stress  that  margin  recovery  occurs  at  Point  X  in  Figure  1 
—  at  the  control  signal  interface  to  the  outside  world.  Asymptotically, 
the  full -state  and  observer-based  implementations  will  have  the  same  tol¬ 
erance  to  disturbances  and  uncertain  elements  inserted  at  this  point.  While 
Point  X  is  clearly  a  physically  important  one  (more  important  than  Point  XX, 
certainly),  engineers  who  may  wish  to  test  robustness  at  still  other  points 
in  the  control  loop  should  recognize  that  the  recovery  results  may  not  be 
applicable  there. 

The  suggested  adjustment  procedure  is  essentially  the  dual  of  a  sensitivity 
recovery  method  suggested  by  Kwakenaak  [7],  The  latter  provides  a  method 
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for  selecting  the  weights  in  the  quadratic  performance  index  so  that  full  - 
state  sensitivity  properties  are  achieved  asymptotically  as  the  control 
weight  goes  to  zero.  In  this  case,  however,  closed  loop  plant  poles  instead 
of  observer  poles  are  driven  to  the  system  zeros,  which  can  result  in  unac¬ 
ceptable  closed  loop  transfer  function  matrices  for  the  final  system. 
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Figure  2.  Loop  Transfer  Functions  of  Example: 

"Fast  Filter"  Adjustment  Procedure 
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*  i*™  Transfer  Function  of  Example: 

Fl9Ure  “Fictitious  Noise"  Adjustment  Procedure 
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APPENDIX  A:  Derivation  of  Property  4 


Referring  to  Figure  1A,  the  loop  transfer  function  from  u"  to  u'  of  the  full 
state  implementation  is  obtained  from  the  relationships 


x  *  «(Bu"  +  Fv) 
u'  =  -H^x  , 

where 

•  *  ($I-A)* 
v  ®  -G^  62x  • 


(A.l) 
(A. 2) 

(A. 3) 
(A. 4) 


The  variables  v  above  are  now  shown  in  Figure  1  for  the  sake  of  simplicity. 

They  denote  the  (m-p)  control  components  for  which  loops  are  not  broken 
in  the  event  that  p  <  m.  Matrices  F,  G^.and  G2  are  to  control  input  matrix 
and  the  feedback  compensator  matrices  for  these  components,  respectively. 

If  the  original  plant  is  square  or  can  be  made  square  by  augmenting  (p-m) 
additional  control  variables,  then  v,  F  G^  and  G2  are  zero  identically.  For 
either  situation,  (A.l)  -  (A. 4)  define  the  following  full-state  loop  trans- 
few  function: 

u'  *  -HjH2  (I  +  *FG1G2)"1  4>Bu"  (A. 5) 

The  corresponding  relationships  for  observer- based  implementations  are 
(Fig.  IB). 

x  «  U*1  +  KC)'1  {Bu'  +  Fv  +  KC*(Bu"  +  Fv)} 
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(A.6) 


«  (♦'*  +  KC)”1  {Bu'  +  KC»Bu"  +  (r1  +  KC)  $Fv} 

=  (*_1  +  KC)’1  (Bu'  +  KCfBu" }  +  $Fv 

with 

u'  =  -HjH2x 

v  =  -GjG^x  (A. 7) 

This  gives 

u'  =  -HjH2(I  +  $FG1G2)'1  d”1  +  KC)”1  {Bu'  +  KCoBu"}.  (A. 8) 

Now  applying  the  Matrix  inversion  lemma  to  the  (#_1  +  KC)”1  term  in  this 
expression  gives 

u'  *  -HjHgd  +  fcFGjGg)’1  ‘  ♦-♦Kd  +  C«»K)”1C<J>  J  (Bu*  +  KC»Bu") 

«  -HjH2(i  +  *fg1g2)-1  *  [b-k(i  +  C$K)_1C*b]  u' 

-HjHgd  +  <*>FG1G2)” 1  #K  (I  +  C<S>K) ” 1  C$B  u\  (A. 9) 

From  (A.9)  it  follows  that  if  (1)  is  satisfied,  then  the  u'  term  on  the 
right  hand  side  vanishes  and  the  u"  term  is  identical  to  (A. 5).  Since  u" 
is  arbitrary,  this  establishes  the  claimed  equality  of  loop  transfer  functions. 
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